Time-Recursive Velocity-Adapted Spatio-Temporal Scale-Space Filters

This paper presents a theory for constructing and computing velocity-adapted scale-space lters for spatio-temporal image data. Starting from basic criteria in terms of time-causality, time-recursivity, locality and adaptivity with respect to motion estimates, a family of spatio-temporal recursive lters is proposed and analysed. An important property of the proposed family of smoothing kernels is that the spatio-temporal covariance matrices of the discrete kernels obey similar transformation properties under Galilean transformations as for continuous smoothing kernels on continuous domains. Moreover, the proposed theory provides an eÆcient way to compute and generate non-separable scale-space representations without need for explicit external warping mechanisms or keeping extended temporal bu ers of the past. The approach can thus be seen as a natural extension of recursive scale-space lters from pure temporal data to spatio-temporal domains.